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The  deviation  of  a  system  function  from  its  nominal  value 
due  to  random  variations  or  the  inherent  uncertainty  of  the 
system  parameters  is  examined.  »<-'"nda  on  various  probabilistic 
measures  of  this  deviation  are  discussed  and  examples  are  given, 
A  comparison  is  made  with  the  deterministic  multiparameter 
sensitivity  function. 

I.  INTRODUCTION 

The  significance  of  parameter  variation  in  linear 
works  and  systems  is  well  known  for  the  case  of  deterministic 
models.  (1-7].  In  many  cases,  however,  it  is  more  appropriate 
to  make  use  of  a  probabilistic  approach  in  studying  the  sensi¬ 
tivity  problem.  This  is  particularly  true  when  the  number  of 
parameters  in  the  network  is  not  small. 

Considerable  interest  has  been  sl'c«/n  in  voi  «."case  vs’-i- 
ation  as  a  sensitivity  measure  of  a  ayytem,  and  procedures 
have  been  given  for  maximum  (minimum)  search  by  computer  [8] . 

An  alternative  approach  to  this  problem  has  been  that  of  de¬ 
riving  bounds  of  the  variations  [9].  However,  the  bounds 
derived  so  far  tend  to  be  pessimistic  [8] .  We  gLvj  here  a 
simple  way  of  calculating  the  approximate  worst-case  perfor¬ 
mance  when  the  variation  of  parameters  is  not  large.  A  com¬ 
parison  is  made  of  this  variation  with  the  results  obtain¬ 
ed  using  the  probabilistic  approach. 

II.  SINGLE  PARAMETER  CASE 


Consider  the  system  function  which  describes  a  linear 
network,  H(u>,x)  where  u)  is  frequency  and  x  is  an  element  in 
the  network.  It  is  well  known  that  H  is  a  bilinear  function 
of  x,  i.e. , 


H(lUiX) 


A(w)  4-  x  B(<u) 
C(t»i)  +  x  D  (id) 


(1) 
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defined  by 


_H  StnH  x  dH 

®x  “  dtnx  H  ax 


(2) 


has  been  used  in  the  study  of  the  change  of  system  performance 
with  respect  to  parameter  variation.  The  real  and  imaginary  * 

H 

parts  of  S  are  related  separately  to  the  amplitude  and  phase 
var:lationsxof  H  caused  by  a  small  change  Ax  in  x.  The  first-  ' 
order  effects  are  given  by 

m  Re  Ax  (3) 
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where  jtij  and  oJh}  and  flarg  H  denote  respectively  the  magnitude 
of  H.  the  change  in  j  hJ  ,  and  the  change  in  the  argument  of  H. 

Traditionally,  the  problem  of  ayatem  sensitivity  and  para¬ 
meter  variation  has  been  treated  by  using  a  deterministic 
approach  by  assuming  the  variation  Ax  is  a  fixed  quantity. 
However,  strictly  speaking,  the  eleiuwni  values  in  a  system  are 
only  known  probabilistically  in  view  of  inherent  uncertainties. 
In  addition,  our  knowledge  of  the  variation  of  the  variation 
of  these  element  values  due  to  aging,  environment  changes,  etc. 
is  conditioned  by  a  certain  degree  of  incompleteness.  It  is 
therefore  more  reasonable  to  take  x  as  a  random  variable  whose 
mean  x  is  regarded  as  its  nominal  value  and  whose  variance 
2 

ox  gives  a  measure  of  its  inherent  inaccuracy. 

At  a  fixed  id,  the  expected  value  of  H(u>,x)  as  given  in 
Eq.  1  is  given  by 


E|inuj#x)]  -  J 


A(id)  4  xB(uu) 
C  (id)  4  xD  (U)J 


p(x)  dx 


where  E  denotes  the  expectation,  and  p(x)  is  the  probability 
density  of  x.  Since  one  normally  takes 


H(<d,x) 


C(ui)  +  xD  (id) 


as  the  nominal  H,  it  is  of  interest  to  compare  the  two  nominal 
values  of  H  as  given  by  Eqs.  5  and  6. 

We  may  write  x  as  x  4  A,  where  the  random  variable  A  has 
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zero  mean  and  variance  o^.  If  a*  is  small,  H(ut,x)  may  be 
expaned  in  a  power  series 

H (<D, x)  -  H(id,x)  +  A  +  i  A2  +  ...  (7) 

dx 


and  the  first  few  terms  can  be  taken  as  a  good  approximation. 
Since  E(A]  *  0,  it  can  be  seen  that  the  dif  tcrcncc  between 
E{ H (id, x) }  and  h(id,x)  is  a  second-order  effect. 

This  result  can  also  be  seen  in  terms  of  a  graphical 
representation.  The  bilinear  Eq.  1  maps  the  real  x  line  into 
a  circle  for  a  fixed  id  as  illustrated  in  Fig.  1(a).  Suppose 
x  deviates  from  its  nominal  value  x  by  a  fixed  6 .  Then 
H(id,x  +  6)  should  be  on  the  circle  as  shown  in  the  slightly 
expanded  illustration  about  H(id,x)  of  Fig.  1(b).  Ths  approxi- 

•nation,  H(id,x)  4  ^  6 ,  obtained  by  taking  only  the  first  two 

terms  in  the  series  expansion,  Eq.  7,  lies  on  the  tangent  to 
the  circle  at  H(uj.x).  Similarly,  H(id,x-6)  is  on  the  circle 

and  H(id,x)  -  Mi  is  on  the  tangent.  Since  the  approximation 
'  d  x 
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lies  on  a  straight  liue  and  since  the  random  deviation  is 
assumed  to  have  zero  mean,  the  resulting  approximation  to 
E{H(uu,x)}  coincides  with  H(uu,x).  The  actual  E{h(uj,x))  would 
lie  somewhere  inside  the  circle  as  shown.  Dy  taking  more 
terms  in  the  power  series,  the  approximation  to  the  expected 
value  of  H  would  approach  its  true  value. 


If  the  exact  distribution  of  x  is  known,  or  a  reasonable 
one  can  be  assumed,  then  El  }  can  be  determined,  though 

in  most  cases  numerical  calculation  by  a  computer  is  required. 

_  2 

For  example,  if  x  is  gaussian  with  mean  x  and  variance  a  ,  Eq. 

1  x 

5  can  be  written  as 


E(H(w,x)  }  -  5  +  (I  -  *?>  i  4 


2  "(-pr— 

1  </2a  D 


(8) 


where  E  ■  A+xB,  F  -  C+xD  and  the  function  W(z) is  related  to 
the  complementary  error  function  by  [10J  W(ss)  ■  e“  ^erfc(-iz) 
If  x  is  uniformly  distributed  between  x  ±  JT  a 


n  '  on  ,  Off  ^  ^  b 

e{H(uj,x)}  -  |  +  PP—Sg  tn  - ~ -2L" 

D  2/3axD  F  -  fSaxD 


x* 


the  result  is 


(9) 


Provided  C/D  is  not  real. 


III.  MULTIPLE  PARAMETER  CASE 

Let  x^  and  x2  be  two  elements  in  a  linear  network.  The 
system  function  H(uj.,  Xj_#  x2)  is  then  bilinear  in  each  of 

and  x,.  We  take  x.  and  x-  to  be  independent  random  variables 

‘  .  ±  *  2  2 
with  means  xA  and  x2  and  variances  and  o2  .  Again, 

H(uj,  x1#  x2)  is  usually  taken  to  be  the  nominal  H  and  it  can 

be  argued  as  before  that  H(u>,  x2)  is  a  good  approximation 

of  the  actual  mean  E(H(uu,  x2)}. 

At  each  <u,  and  for  each  fixed  x2>  the  locus  of  H  as  a 
function  of  x.  is  a  circle,  and  for  each  x. ,  the  locus  of  H 

A  — 

as  a  function  of  x2  is  also  a  circle.  Suppose  the  value  of 

is  to  vary  between  x1  ±  and  the  range  of  x2  is  x2  ±  &2, 

then  the  variation  of  H{u>,  x^,  x2)  is  as  illustrated  in  Fig.  2. 

The  value  of  H  is  then  limited  to  the  region  bounded  by  the 
four  dashed  circular  arcs.  If  none  of  these  four  arcs  is 
tangent  to  circles  with  center  at  the  original,  or  to  straight 
lines  passing  through  the  origin,  it  is  seen  that  the  extremes 
of  | H j  and  arg  H  can  occur  only  at  the  "comer  points,”  a,b,c, 
or  d.  Even  when  this  is  not  true  because  some  of  the  arcs 
are  tangent  to  circles  with  center  at  origin  or  to  straight 


1.  For  simplicity,  the  argument  is  sometimes  omitted. 
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linos  through  the  origin,  the  extreme  values  evaluated  at  the 
corners  are  still  very  good  approximations  to  the  true  extremes. 
Tha  above  argument  can  be  extended  to  situations  with  more  than 
two  parameters.  Figure  3  illustrates  a  3-parameter  case. 

The  significance  of  the  problem  of  worst-case  variation 
has  been  recognized  by  many  authors.  Most  of  the  results  in 
the  past  have  concentrated  along  two  lines.  The  first  is  to 
device  bounds  which  usually  turn  out  to  be  rather  pessimistic. 
The  second  is  to  actually  search  for  the  extremes  in  the  para¬ 
meter  space  and  usually  requires  considerable  computational 
effort.  The  observation  made  above  can  be  used  to  determine 
approximately  the  worst  case  variation  of  U  by  aimply  evalua¬ 
ting  H  at  all  of  the  comer  points  and  comparing  the  results. 
Thus  for  a  network  of  n  parameters,  with  range  x^  ±  6 . * 

i  *  l,2,...n,  one  needs  to  calculate  H  for  each  of  the  21*1 
combinations  of  the  parameter  values,  =  x.  ±  6^.  The 

extremums  obtained  in  this  manner  can  be  taken  as  approxima¬ 
tions  of  the  actually  extremums. 

As  an  illustration,  consider  the  third-order  Chebyshev 
low-pass  filter  shown  in  Fig.  4.  The  sensitivity  problem  of 
Uiis  network  has  been  studied  by  Kelly  [8]  who  calculated  the 
actual  maximum  and  minimum  of  the  amplitude  characteristic. 

The  result  of  calculation  based  upon  the  approach  outlined 
above  is  shown  in  Fig.  5  for  ±5%  and  ±10%  variations  of  all 
elements.  Also  shown  is  the  actual  maximum  and  minimum  as 
calculated  by  Kelly.  For  this  order  of  parameter  variation, 
it  is  seen  that  our  method  gives  reasonably  good  approximations 
except  near  the  cut  off  frequency  where  the  change  iB  fast. 
However,  if  the  range  of  variation  is  increased,  one  should 
expect  that  our  approximation  procedures  will  not  give  reliable 
results. 


IV.  MULTIPARAMETER  SENSITIVITY  AND  STATISTICAL  VARIATION 

Let  xi#  i  =  l,2,...n  be  element  values.  The  first  order 

approximation  to  the  variation  in  the  system  function 
H(ui,x1,x2t . . .  ,xn)  are  related  to  the  real  and  imaginary  parts 

◦f  the  sensitivities  through  the  relationships 


a  I  u  I  n  H  Ax. 

■  n  A  *.  " 


[hT 


«  t  (Re  Sv  ) 
i-1  xi 


x . 
x 


(10) 


and 


n 


L  arg  H  w  Z  (Iro  S**  )  1 1 

i-1  xi  xi 

,H 


Ax . 


(ID 


where  the  sensitivities  S  are  defined  in  the  usual  manner, 
i.e.,  xi 


-H  ,  1 

bXi  dXj  H 


(12) 
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and  the  Ax.' a  are  the  deviations  from  their  nominal  values  x^. 

Wo  take  the  x , ' s  to  be  independent  random  variables  with  mean 
1  2 

x.  and  variance  o^.  Thus 


X  ,  “ 

i 

x.  +  6  , 

l  i 

(13) 

with 

E(6i)  -  0, 

E(6i2)  «  oi2 

(14) 

Equations 

10  and  11  may  be  written  as* 

%  -  j 

(R«  S”  ) 

1  xi  xi 

(15) 

and 

n 

Aarg  H  «  £ 

i«l 

(to  s“  )  ^ 
xi  xi 

(16) 

with  | Hj 

**  |  H  (ui ,  X ^ » Xj » •  •  • 

xn) | .  In  view  of  Eqs. 

13  and  14,  we 

have 

0 

(17) 

E{A  arg  H} 

-  0 

(18) 

•ifflft  ■ 

h  H  2  2 

E  (Re  S“  )  0  * 

i-1  xi  1 

(19) 

and 

e{[a  arg  hJ2 

}  -  £  (to  s“  )  o2 

J  i-1  xi  1 

(20) 

If  the  range  of  6 .  is  restricted  to  ±  A . ,  then  it  is  clear 
that  the  extrema  of  1  a|h|/|h|  are  given  by 


(21) 

(22) 


One  may  take  iko^,  with  a  proper  choice  of  k,  as  the 

range  of  the  variation  of  parameter2  xi.  Then  the  range  of 
variation  using  the  extrema  is 

n  o . 

Range.  -  2k  £  I  Re  s“  |  (23) 

_ * _ i-1  xi  xi 

2  That  is.  if  k  is  taken  as  3,  then  the  element  will  be  within 
this  range  with  probability  better  than  0.997. 

*ln  che  discussion  to  follow,  wa  replace  <-  by  -  rather  than 
discuss  the  precise  meaning  of  the  approximation. 


2 

and  the  range  using  i  %  1 H I '  w*lore  a^lH{  the  var-'-ance  oi: 

ThT  ThT 

A i H | / | H| ,  and  is 


n  2o.2 

Range  -  2k  V  Z  (Re  )  (--} 

11  i^l  xi  xi 

That  Range x  £  Range^  follows  from  an  elementary  inequality. 

In  fact,  for  most  cases,  one  will  find  Range^  to  be  consid¬ 
erably  smaller  than  Rangej. 

The  third-order  Chebyshev  filter  is  used  agi\-Ln  as  an 
illustration.  The  sum  of  the  absolute  value  Re  SH  in  calcu¬ 
li 

lated  to  be  1.3390  at  u)/2rr  =  0.1,  1.401"*  at  oi/2n  »  0.15,  and 
2.8755  at  ou/2n  «  0.2,  where  as  the  square  root  of  the  sum  of 
the  squares  of  the  real  parts  of  the  individual  sensitivities 
are  0.7756,  0.7310,  and  1.6730  at  these  frequencies.  That  is, 
for  this  example,  the  extreme  range  of  variation  Range£  is 

almost  twice  as  large  as  a  meaningful  measure  should  be. 

Figure  6  shows  the  ranges  as  determined  by  the  extrema  and  as 
determined  by  the  variances  of  A|h|/|h|  at  uj*  1.0  and  1.5, 
using  K  »  3.  Also  sketched  in  the  figure  are  the  probability 
density  functions. 

When  the  distributions  of  the  elements  are  not  gaussian, 
one  can  not  draw  the  definitive  result  as  given  above.  But  if 
the  number  of  terms,  in  Eq.  15  is  not  too  small  and  if  no  term 
in  the  sum  clearly  dominates,  then  the  final  distribution  of 
A | H| /j  H|  will  still  be  approximately  gaussian  [11].  Suppose 
the  elements  in  the  example  of  the  Chebyahev  filter  are  uni¬ 
formly  distributed,  then  the  probability  density  of  a|h|/|h| 
is  that  of  the  successive  convolution  of  five  rectangular 
shapes  of  proper  width. 

The  result  is  also  sketched  in  Fig.  6.  If  one  takes  ±3o 
as  the  range  of  variation,  it  is  seen  that  with  probability 
better  than  ,92,  a|h|/|h|  will  be  within  the  range  when  the 
elements  are  uniformly  distributed. 
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The  deviation  of  a  network  function  from  its  nominal  value  due  to 
random  variations  or  the  inherent  uncertainty  of  network  parameters  is 
studied  in  this  paper. 

Consider  the  network  function  H(  w,  x. ,  x7 ,  . . . ,  xn)  where  u>  is  the 
frequency  variable  and  the  x's  are  the  parameters.  It  is  well  known 
that  H  is  bilinear  in  each  of  the  x's.  Each  x^  is  a  random  variable 
with  mean  x\  and  variance  Cj_2.  The  mean“x£  is  usually  taken  to  be  the 
nominal  value  and  the  variance  is  related  to  the  tolerance.  .It  is 
shown  that  the  mean  of  H,  e(hj  ,  is  approximately  equal  to  H(U),"x-t  ,X2»  •  •  .x 
the  value  of  H  when  all  the  parameters  take  on  their  nominal  values. 

For  small  c^/x;,  the  variances  of  H  are  shown  to  be  realted  to  the 
classical  single  parameter  sensitivity  Sx^.  When  the  x's  are  Gaussian, 
the  distribution  of  H  can  be  determined.  When  the  x's  are  not  Gaussian, 
various  probabilistic  bounds  can  be  obtained  by  inequalities  such  as 
that  of  Chebyshev. 

This  paper  also  presents  a  method  of  calculating  approximately  the 
deterministic  worst  case  parameter  variation.  A  comparison  is  made  of 
this  variations  with  the  results  obtained  using  the  probabilistic 
approach,  and  it  is  shown  that  the  conventional  deterministic  worst 
case  design  criterion  is  in  general  too  pessimistic,  especially  when 

the  number  of  parameters  is  not  small. 
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